L1/2 Norm Regularized Echo State Network for Chaotic Time Series Prediction
نویسندگان
چکیده
Echo state network contains a randomly connected hidden layer and an adaptable output layer. It can overcome the problems associated with the complex computation and local optima. But there may be ill-posed problem when large reservoir state matrix is used to calculate the output weights by least square estimation. In this study, we use L1/2 regularization to calculate the output weights to get a sparse solution in order to solve the ill-posed problem and improve the generalized performance. In addition, an operation of iterated prediction is conducted to test the effectiveness of the proposed L1/2ESN for capturing the dynamics of the chaotic time series. Experimental results illustrate that the predictor has been designed properly. It outperforms other modified ESN models in both sparsity and accuracy.
منابع مشابه
Noisy Chaotic Time Series Prediction Based on Wavelet Echo State Network
As a research focus of intelligence algorithm, the prediction of classic noiseless chaotic time series has a great development in recent years. However, the existing prediction models cannot get good performance for real-world chaotic time series because of the interference of noise components. In order to take full advantage of the property of real-world chaotic time series, the paper proposes...
متن کاملModel Based Method for Determining the Minimum Embedding Dimension from Solar Activity Chaotic Time Series
Predicting future behavior of chaotic time series system is a challenging area in the literature of nonlinear systems. The prediction's accuracy of chaotic time series is extremely dependent on the model and the learning algorithm. On the other hand the cyclic solar activity as one of the natural chaotic systems has significant effects on earth, climate, satellites and space missions. Several m...
متن کاملWavelet-network Based on L1-norm Minimisation for Learning Chaotic Time Series
This paper presents a wavelet-neural network based on the L1-norm minimisation for learning chaotic time series. The proposed approach, which is based on multi-resolution analysis, uses wavelets as activation functions in the hidden layer of the wavelet-network. We propose using the L1-norm, as opposed to the L2-norm, due to the wellknown fact that the L1-norm is superior to the L2-norm criteri...
متن کاملChaotic Analysis and Prediction of River Flows
Analyses and investigations on river flow behavior are major issues in design, operation and studies related to water engineering. Thus, recently the application of chaos theory and new techniques, such as chaos theory, has been considered in hydrology and water resources due to relevant innovations and ability. This paper compares the performance of chaos theory with Anfis model and discusses ...
متن کاملThe combination of circle topology and leaky integrator neurons remarkably improves the performance of echo state network on time series prediction
Recently, echo state network (ESN) has attracted a great deal of attention due to its high accuracy and efficient learning performance. Compared with the traditional random structure and classical sigmoid units, simple circle topology and leaky integrator neurons have more advantages on reservoir computing of ESN. In this paper, we propose a new model of ESN with both circle reservoir structure...
متن کامل